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Application No. 



Applicant(s) 



Interview Summary 



10/812,417 



AGARWAL ET AL. 



Examiner 



Art Unit 



Michael D. Pham 



2167 



All participants (applicant, applicant's representative, PTO personnel): 



(1) Michael D. Pham . 



(3) Leila Abdi (reo#: 52.399) . 



(2) Cam Y Truong . 



Date of Interview: 06 September 2007 . 

Type: a)[3 Telephonic b)D Video Conference 

c)D Personal [copy given to: 1)D applicant 2)S applicant's representative] 

Exhibit shown or demonstration conducted: d)D Yes e)G3 No. 
If Yes, brief description: . 

Claim(s) discussed: Claim 1 . 

Identification of prior art discussed: Hillis . 

Agreement with respect to the claims f)D was reached. g)S was not reached. h)Q N/A. 



Substance of Interview including description of the general nature of what was agreed to if an agreement was 
reached, or any other comments: See Continuation Sheet 

(A fuller description, if necessary, and a copy of the amendments which the examiner agreed would render the claims 
allowable, if available, must be attached. Also, where no copy of the amendments that would render the claims 
allowable is available, a summary thereof must be attached.) 

THE FORMAL WRITTEN REPLY TO THE LAST OFFICE ACTION MUST INCLUDE THE SUBSTANCE OF THE 
INTERVIEW. (See MPEP Section 713.04). If a reply to the last Office action has already been filed, APPLICANT IS 
GIVEN A NON-EXTENDABLE PERIOD OF THE LONGER OF ONE MONTH OR THIRTY DAYS FROM THIS 
INTERVIEW DATE, OR THE MAILING DATE OF THIS INTERVIEW SUMMARY FORM, WHICHEVER IS LATER, TO 
FILE A STATEMENT OF THE SUBSTANCE OF THE INTERVIEW. See Summary of Record of Interview 
requirements on reverse side or on attached sheet. 



Examiner Note: You must sign this form unless it is an 
Attachment to a signed Office action. 
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Interview Summary 



Paper No. 20070910 



Continuation Sheet (PTOL-413) 



Application No. 10/812,417 



* Continuation of Substance of Interview including description of the general nature of what was agreed to if an 
agreement was reached, or any other comments: 



Applicant's representative asserted a new issue stating that the provisional application does not disclose the material in 
US2005/0131918 by Hillis, cited in the last office action. However, the examiner's disagreed with applicant's 
representative that the provisional application did not support the Hillis reference, and further cited portions of the 
provisional that supported the prior amended limitations, "selecting a plurality of evaluators to rate the document" as 
supported in the provisional page 5 line 10 as user profiles specifies (selecting) which repuation systems, page 5 lines 
6-9, reputation systems (evaluator) return set of statistics and rating (rate) for content (document). Further stating that 
"passing the document to the plurality of evaluators for rating" as supported in the provisional page 5 line 6, each 
reputation system (evaluators) returns a set of statistics for a given (passing) piece of content (document) within the 
database. Applicant's then raised an issue of prior limitation "determining whether to deliver the document in 
response to the signal based on the criteria and the rating information from the one or more evaluators". However, the 
examiner responded by stating that this was already addressed in the first action of which applicant's had no 
arguments for, and further was maintained in the final office action. It was concluded that the final assertion made by 
Applicant's representative would not be addressed at this time due to time constraints and specific detail not addressed 
in the agenda. Applicant's representative was advised to create specific arguments in lieu of a broad assertion with no 
claim specifics in the agenda provided 9/5/07. At that point, the interview was adjourned. 
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Attorney's Docket No.; 16113-641001 
Client's Ref. No.: GP-254-00-US 



OFFICIAL COMMUNICATION FACSIMILE: 



OFFICIAL FAX NO: (571)273-3924 



Number of pages including this page 16 



Applicant : Agarwal, et al. 
Serial No. : 10/812,417 



Art Unit : 2167 
Examiner : Michael Pham 



Filed : March 30, 2004 

Title : System and Method For Rating Electronic Documents 

Dear Examiner Pham: 

We have tentatively scheduled a telephonic interview regarding United States 
Application Serial No, 1 0/812,417 on September 6, 2007. Attending this interview for the 
Assignee will be Leila Abdi, representative for the assignee. The following is a list of agenda 
items that we would like to discuss during the interview: 

1) The 35 U>S,C, 102(e) reference Hillis has a 102(e) date of December 12, 2003 (the date 
of the provisional). The provisional application (60/529,245) (attached) does not disclose the 
material disclosed in US 2005/0131918 (Hillis), which is cited in the latest Office Action. 



Fish & Richardson P,C, 

1 180 Peachtree Street, N,E„ 21st Floor 

Atlanta, OA 30309 

Telephone: (404) 892-5005 

Fax; (404)892-5002 



12Q33486\doc 



NOTE: This facsimile is intended for the addressee only and may contain privileged or confidential 
information. If you have received this facsimile in error, please immediately call us collect at 
(404) 892-5005 to arrange for its return. Thank you. 



Respectfully submitted, 



Date: September 5, 2007 




Leila R. Abdi 
Reg. No. 52,399 
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Corr^I^ioner for Patents. Mall Stop Provisional Patent Application. P.O. Box 14S0. Alexandra VA 22313-1450 
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<fa-£UiL,/aL ^Ljau^ Attorney Docket No. APPL00Q7CI2PR 



Rhonda Dunn 

IN THE U.S. PATENT AND TRADEMARK OFFICE 
Provisional Application Cover Sheet 

Assistant Commissioner tor Patents 
Mail Stop Provisional Patent Application 
P.O. Box 1450 
Alexandria, VA 22313-1450 

December 12, 2003 

Sin 

This is a request for filing a PROVISIONAL APPLICATION FOR PATENT under 37 CFR 1 .53(b)(2). 

INVENTOR(s)/APPLICANT(s) 



-3 

CM 



Last Name 


Rrst Nam© 


Middle Initial 


Residence (City and Either State or Foreign Country 


Hillis 


W. 


Daniel 


Glendale, California 91201 


Cook 


Robert 




San Francisco, California 94110 


Boflacter 


Kurt 




San Francisco, California 941 1 0 



Title of the Invention 



Re putation System 



Correspondence Address 



Michael A, Glenn 

3475 Edison Way, Suite L 

Menlo Park, CA 94025 



Customer No. 22862 
Telephone No. (650) 474-8400 



□ 



Enclosed Application Parts (check all that apply) 



(X) Specification and Drawing(s) 
Number of Pages 13 



( ) Small Entity Statement - Small Business 



Filing Fee and Method of Payment 



J£ $80.00 for Small Entity 



.$160.00 for Large Entity 



The Commissioner is authorized to charge the filing fee of $80.00 and any additional fees or credit any 
overpayment to Deposit Account No. 07-1445 (Outer No. APPL0007CI2PR), A copy is enclosed for this 
purpose. 

Respectfully Submitted, 



Michael A. Glenn 
Reg. No. 30,176 



Customer No. 22662 
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Personalized Tfrust Profile 
Based on Multiple Reputation Systems 

Invention Disclosure Form 
April 23, 2003 



Inventors 

Indicate the names of all persons who made a contribution to the conception and/or reduction to 
practice of the invention. 



Inventor 


W. Daniel HillLe 


Position 


Chief Technological Officer 


Home Address 


4750 Encino Ave. 
Encino, CA 91316 
United States 


Work Address 


1209 Grand Central Ave. 
Glendale, CA 91201 


Home Phone 


(818) 761-9781 


Work Phone 


(818) 545-1402 


Citizenship 


United States 


Email 


dannyOappliedmiads . net 


Inventor 


Robert Cook 


Position 


Software Architect 


Home Address 


21 Samoset Street 

San Francisco, CA 94110 

United States 


Work Address 


357 Tehama St. 4th FL 
San Francisco, CA 94103 


Home Phone 


(415) 821-5891 


Work Phone 


(415) 546-2000 


Citizenship 


United States 


Email 


robertQapliedminds .net 


Inventor 


Kurt Bollacker 


Position 


Software Architect 


Home Address 


3025 21st St, Apt 7 
San Francisco, CA 94110 
United States 


Work Address 


357 Tehama St : 4th FL 
San Francisco, CA 94103 


Home Phone 


(415) 647-6775 


Work Phone 


(415) 546-2002 


Citizenship 


United States 


Email 


kbollackerOappaiadsf , com 
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Conception of the Invention 
Indicate the information surrounding the conception of the invention. 

Date of conception: April 6, 2003 
Place of conception* San Francisco 

Location of first written description: In an email sent by Danny Hillis on April 6, 2003, to 
Kurt BoUacker, Robert Cook, and Mark Duttweiler. 



Project Information 

If applicable, indicate the project name under which the invention was conceived and/or reduced 
to practice. If applicable, provide the date of the first showing or demonstration of the invention 
as part of the project. Also indicate any projects to which the invention's relevance should be 
considered. 



Not applicable. 



Product Information 

If applicable, indicate the product name under which the invention is or will be offered for sale. 
Provide the date of the first public showing and manufacturing release of the product. 

Not applicable. 



Reduction to Practice 

If applicable, indicate the extent to which the invention has been reduced to practice. That is, 
indicate to what extent the invention has been simulated, built, or tested. Provide the date of any 
such reduction to practice. 



Not Applicable. 
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Applied Minds, Inc. April 23, 2QQ3 IDF: Trust Profile 

Publication 

If applicable, indicate when and where the invention has been described in a publication. 
Not applicable. 

Government Contract 

If applicable, indicate the government contract under which the invention was conceived and/or 
reduce to practice. 

Not applicable. 

References 

List any printed publications, patents, patent applications, or any other materials you are aware 
of, which provide background material and/or prior art for your invention. 

See the related IDP "Reputation System Based on Allocated Authority". 

See the emails sent by Danny Hillis on April 6, 2003, to Kurt Bollacker, Robert Cook, and Mark 
Duttweiler. Signed hardcopies of these emails also exist. 
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Applied Minds, Inc. 



April 23, 2003 



IDF; Trust Profile 



Problem Statement and Prior Art 



State the problem that was to be solved. Describe bow other? had solved it before you. Describe 
the problems and disadvantages associated with prior solutions. 



Many locations within the World Wide Web allow users to submit reviews and comments for existing 
web based material. For example t Amazon allows users to submit reviews of books, including a 
zero to five star rating, and Slashdot allows users to comment on recently posted articles. 

However, such sites are typically limited in their ability to indicate the trustworthiness of these 
reviews and comments. Amazon allows other users to rate submitted reviews, by indicating that 
they "found a review helpful", Slashdot allows users to annotate submitted comments with an 
overall score and attributes such as "funny" or "informative" . The large number of submitted 
comments can then be filtered based on these annotations. 

While offering some degree of utility, each of these approaches relies essentially on a <l masB con- 
sensus" in which each contributor of reviews and ratings possesses equal authority, Moreover, 
the manner in which the reviews and scores are utilized cannot be extensively customized by a 
particular user. 



State your goals in creating the invention, in particular the improvements over the prior art that 
were desired. 



The goal of the invention is a personalized trust profile combining multiple reputation systems to 
yield a reliable measure of the trustworthiness of a particular piece of content located within a 
large database of annotated content. In particular, the invention should allow users to combine 
the reputation systems in a flexible manner that varies depending on the type of content under 
consideration. 



Goals of the Invention 
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Applied Minds, Inc. April 23, 2003 IDF: Trust Profile 



Description of the Invention 

Describe the structure, function and/or method of the invention. Stress the fundamental principle 
of the new idea from an engineering standpoint. Use drawings, flow charts, and block diagrams if 
needed. 



The invention provides a method of evaluating content presented to a user from within an annotated 
dat abased based on evaluations returned from one or more reputation systems. 

Each reputation system returns a set of statistics for a given piece of content within the database. 
(See the related disclosure in the References section for more information on reputation systems.) 
Generally, the statistics indicate the reliability and trustworthiness of the content. For example, 
the reputation system may return a rating between -1 and 1. 

A user profile specifies which reputation systems the user considers reliable, to which degree, and for 
which purposes. Fbr a given purpose, for example entertainment reviews, the reputations systems 
considered reliable are combined to determine an overall evaluation of the trustworthiness of the 
content. For example, several reputation systems may be combined using a weighted averaging 
scheme, the weights reflecting the relative degree to which the user trusts each reputation system. 

The reputations systems utilized and the relative weightings may be varied depending on the data 
type of the content, as indicated by the annotations within the database. For example, a user 
may specify one trust profile for content of a scientific nature, and another trust profile for content 
related to entertainment. Further, a number of trust profiles themselves may be further combined 
to yield profiles of profiles. For example, a "literature" trust profile and a "medicine" trust profile 
may be combined to yield a profile suitable for evaluating medical literature. 

The trust profile may be used to present the resulting evaluation of trustworthiness to the user as 
the content is viewed. Alternatively, especially during searches for content, a threshold may be set 
and only content with on evaluation exceeding the designated threshold returned. 

Trust networks may also be constructed based on reputations systems that evaluate content based 
on criteria other than reliability and trustworthiness, such as usefulness, thoroughness, and origi- 
nality. 
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Applied Minds, Inc. 



April 23, 2003 



IDF: Trust Profile 



Inventor Signatures 

This invention Disclosure Form is submitted pursuant to your employment agreement with Applied 
Minds, Inc. 



Signature: 
Witnessed: 

Signature: 
Witnessed: 

Signature: 
Witnessed: 



Date: 
Date: 

Date: 
Date: 

Date: 
Date; 



Read and Understood 

This Invention Disclosure Form may be used in legal proceedings regarding this invention. For it 
to be used for such purposes, it is important that it be read and understood by two individuals. 



Name: 



Signature: 
Date; - 



Witnessed: 
Date: 



Name: 

Signature; 
Date; 



Witnessed: 
Date: 
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Reputation System Based on Allocated Authority 

Invention Disclosure Form 
April 23, 2003 



Inventors 

Indicate the names of all persons who made a contribution to the conception and /or reduction to 
practice of the invention. 



Inventor 


W. Daniel Hillis 


Position 


Chief Technological Officer 


Home Address 


4750 Encino Ave. 
Encino, CA 91316 
United States 


Work Address 


1209 Grand Central Ave, 
Glendale, CA 91201 


Home Phone 


(818) 761-9781 


Work Phone 


(818) 545-1402 


Citizenship 


United States 


Email 


danny Qappliedminds . net 


Inventor 


Robert Cook 


Position 


Software Architect 


Home Address 


21 Samoset Street 

San Rrancisco, CA 94110 

United States 


Work Address 


357 Tehama St, 4th PI. 
San Francisco, CA 94103 


Home Phone 


(415) 821-5891 


Work Phone 


(415) 546-2000 


Citizenship 


United States 


Email 


robertQapliedmincLs .net 


Inventor 


Kurt Bollacker 


Position 


Software Architect 


Home Address 


3025 21st St, Apt 7 
San Francisco, CA 94110 
United States 


Work Address 


357 Tehama St, 4th PL 
San Francisco, CA 94103 


Home Phone 


(415) 647-6775 


Work Phone 


(415) 546-2002 


Citizenship 


United States 


Email 


kbolIackerQappmindsf » com 
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Applied Minds, Inc. _ _. April 23,, 2003 IDF: Reputation System 



Conception of the Invention 

Indicate thq information surrounding the conception of the invention. 



Date of conception; April 6, 2003 
Place of conception; San Francisco 

Location of first written description: In an email sent by Danny Hillis on April 6, 2003, to 
Kurt Bollacker- Robert Cook, and Mark Duttweiler. 



Project Information 

If applicable, indicate the project name under which the invention was conceived and/or reduced 
to practice. If applicable, provide the date of the first showing or demonstration of the invention 
as part of the project. Also indicate any projects to which the invention's relevance should be 
considered. 



Not applicable. 



Product Information 

If applicable, indicate the product name under which the invention is or will be offered for sale. 
Provide the date of the first public showing and manufacturing release of the product. 



Not applicable. 



Reduction to Practice 

If applicable, indicate the extent to which the invention has been reduced to practice. That is, 
indicate to what extent the invention has been simulated, built, or tested. Provide the date of any- 
such reduction to, practice. 



Not applicable. 
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Applied Minds, Inc. April 23, 2003 IDF; Reputation System 



Publication 

If applicable, indicate when and where the invention has been described in a publication. 
Not applicable. 



Government Contract 

If applicable, indicate the government contract under which the invention was conceived and/or 
reduce to practice. 

Not applicable. 



References 

List any printed publications, patents, patent applications, or any other materials yon are aware 
of, which provide background material and/or prior art for your invention. 

See the related IDF "Personalized Trust Profile Based on Weighted Reputation Systems*. 

See the emails sent by Danny Hillis on April 6, 2003, to Kurt Bollacker, Robert Cook, and Mark 
Duttweiler. Signed hardcopies of these emails also exist. 
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Problem Statement and Prior Art 

State the problem that was to be solved. Describe how others had solved it before you. Describe 
the problems and disadvantages associated with prior solutions. 



Marry locations within the WorJd Wide Web allow users to submit reviews and comments for existing 
web based material, fbr example, Amazon allows users to submit reviews of books, including a 
zero to five star rating, and Slashdot allows users to comment on recently posted articles. 

However, such sites are typically limited in their ability to indicate the trustworthiness of these 
reviews and comments. Amazon allows other users to rate submitted reviews, by indicating that 
they "found a review helpful". Slashdot allows users to annotate submitted comments with an 
overall score and attributes such as "funny" or ^informative" . The large number of submitted 
comments can then be filtered based on these annotations 

While offering some degree of utility, each of these approaches relies essentially on a "mass con- 
sensus" in which each contributor of reviews and ratings possesses equal authority. Moreover, 
the maimer in which the reviews and scores are utilized cannot be extensively customized by a 
particular user. 



Goals of the Invention 

State your goals in creating the invention, in particular the improvements over the prior art that 
were desired. 



Hie goal of the invention is a reputation system providing users with , a reliable measure of the 
trustworthiness of a particular piece of content located within a large database of annotated content. 
In particular, the system should allow contributors of ratings to be assigned varying degrees of 
authority. 
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Description of the Invention 

Describe the structure, function and/or method of the invention. Stress the fundamental principle 
of the new idea from an engineering standpoint, Use drawings, flow charts, and block diagrams if 
needed. 



The core components of the proposed reputation system are sources of authority, contributing 
authorities, and pieces of content within the annotated database. A particular reputation system 
is based on one or more sources of authority. Each source of authority designates a number of 
contributing authorities, allocating to each a specific amount of authority. In turn, each contributing 
authority utilizes its allotment of authority to designate other contributing authorities Finally, 
contributing authorities rate individual pieces of content within the database. In this manner, the 
degree of "trust" the reputation system places in the sources of authority is propagated through a 
distributed network of contributing authorities, and ultimately the database content. 

The total amount of authority allocated by a contributing authority must not exceed the total 
amount of authority it was itself allocated, multiplied by an attenuation factor. The amount of 
authority allocated is thus attenuated with each degree or removal from the source of authority. An 
attenuation of £ is particularly effective, in that it ensures that conspiring contributing authorities 
cannot allocate authority to one another in an attempt to elevate their total authorities. 

The total amount of authority within the reputation system is therefore expressly determined by 
the sources of authority. Accordingly, it is important fchat the sources of authority act prudently. 
However, because a reputation system may add or drop sources of authority, and because a repu- 
tation system itself is voluntarily utilized or ignored by the community of database users, there is 
strong incentive for the sources of authority to behave judiciously. 

The authority allotted to one contributing authority by another contributing authority may be 
negative. That is, the contributing authority may indicate a level of "distrust" for the designated 
contributing authority. FV>r the designating contributing authority, this expression of negative 
sentiment counts in a positive manner towards the allotment of authority it may allocate. However, 
it is considered in a negative manner when calculating the amount of authority the designated 
contributing authority may allocate. 

Each contributing authority also rates an unlimited number of pieces of content within the database. 
The reliability and trustworthiness of each piece of content is rated numerically on a scale from 
0 to 1. Alternatively, the contributing authority may rate the pieces of content with an arbitrary 
scale that is the normalized by the largest rating. A numerical scale ranging from —1 to 1 may be 
used if it is desirable that a contributing authority be able to rate a piece of content as notably 
"untrustworthy". 

The network of authority is used to determine a rating for a particular piece of content as judged 
by the reputation system. This is accomplished by considering the one or authorities rating the 
content. These ratings are combined using a weighted average. Fbr example, for content rated r 4 
by authority i among N rating authorities, authority i having a total delegated authority of w it 
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Applied Minds, Inc. 



April 23 T 2003 



IDF: Reputation System 



the rating is 



where 



This method of computing the trustworthiness of content offers several notable advantages. First, 
because the rating methodology is "outwardly propagating" from the sources of authority, the 
rating for a piece of content can be computed and stored "local" to the content. That is, it is 
not necessary to consult a centra! server ( for example associated with the source of authority) to 
determine the rating. Each piece of content must merely consider the ratings it has received and 
the authority associated with that rating to determine its own overall rating. Concerns regarding 
falsification of ratings can be addresses using encrypted authority tokens. 

Second, updating the reputation system is a, straightforward process. Each contributing authority 
delegates authority as a fraction of its allotted authority. Thus, without intervention from the 
contributing authority, authority newly injected by a source of authority is automatically propar 
gated outward through he reputation system. Addition of sources of authority and redistribution 
of allotted authority by contributing authorities is updated in a similar manner. 

In an alternative approach, a rating for a piece of content is computed with respect to each source 
of authority in the reputation system as described above. An overall rating for the content is then 
calculated by combining the individual ratings by adding, averaging, or weighted averaging. For 
example, the reputation system may assign a relative importance to each source of authority, and 
the individual ratings are combined in a weighted averaging scheme with the relative importances 
serving as weights. 

It should be noted that a different reputation system may be constructed for each data type within 
the database. The data type of a particular piece of content is indicated by the type of link to the 
content, and a particular reputation system is invoked accordingly- For example, one reputation 
system may be constructed for medical journals, and another for movie reviews. Also, reputation 
systems may be constructed in which the content is rated based on criteria other than reliability 
and trustworthiness, such as usefulness, thoroughness, and originality. 

Variations on the described system are possible. For example, it is possible for a source of authority 
to directly rate a piece of content. In this case, the total delegated authority used in the weighted 
average may either be considered equal to the sum of all authority delegated by the source of 
authority, or, alternatively, a smaller number chosen by the authority reflecting its confidence in 
the assigned rating. 

Also, a source of authority may designate another source of authority as a designated authority. In 
this case, the designated source of authority functions as a contributing authority with respect to 
the designating source of authority. 
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